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This listing of claims will replace all prior versions, and listings, of claims in the 
application: 




Claim 1 (Currently Amended): A method for dotormin i ng a gooturo 
automatically controlling a d evice comprising the steps of: 

determining a change in a background of an image from a plurality of 
images; 

determining an object in the imag o, sa i d dotorm i n i ng stop furthor 
compris i ng tho ctopo of: 

obta i ning a norma li zod co l or roprosontat i on for a p l urality of co l ors 
i n oaoh i mago; 

dotorm i ning from tra i n i ng imag e s an e st i mat e of a probab ili ty 
distribut i on of norma li z e d color va l u e s for an objoct c l ass; and 
dotormining, for oach pixo l , a li ko li hood accord i ng to an ost i matod 
probab ili ty donc i ty of norma l izod co l or va l uoG for tho objoct doss; 
identifying a gesture according to the trajectory of the object: 
determining if the gesture corresponds to a valid command: and 
if the gesture corresponds to a valid command, executing the command. 
dotormin i ng a trajoctory of tho objoot through tho plura li ty of imagoc; and 
c l ass i fy i ng a gooturo accord i ng to tho trajoctory of tho objoct. 

Claim 2 (Original): The method of claim 1 , wherein the step of determining the 
change in the background further comprises the steps of: 

determining a gradient intensity map for the background from a plurality of 
images; 

determining a gradient intensity map for the current image; 
determining, for a plurality of pixels, a difference between the gradient 
intensity map and the gradient intensity map for the background; 

determining a comparison between the difference and a threshold; and 
determining a pixel to be a background pixel according to the comparison. 

Claim 3 (Original): The method of claim 1 , wherein the object includes a user's 
hand. 

/ 

Claim 4 (Canceled). 

/ 

Claim 5 (Canceled). 
Claim 6 (Canceled). 
Claim 7 (Canceled). 
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Claim 8 (Currently Amended): The method of claim 1 , wherein the step of 
c l ass i fy i ng translating the gesture further comprises the steps of: 
determining a reference point; 

determining a correspondence between the trajectory and the reference 
point; and 

class i fy i ng translating the trajectory according to one of a plurality of 
commands. 

Claim 9 (Currently Amended): A method for determining a trajectory of a hand 
through a plurality of images comprising the steps of: 
detecting a reference point; 

updating the reference point as the reference point is varied; 

detecting a first translation of the hand through the plurality of images; 

detecting a second translation through the plurality of images such that a 
normalized vector is determined between two centroids Ot and c^asa feature 
vector such that there is a vertical movement output pattern, a horizontal output 
pattern and an unknown output pattern : 

comparing the reference point to a centroid upon determining the 
translation to be a vertical or a horizontal translation: 

testing an input pattern upon determining the translation to be an unknown 
translation: 

determining a gesture according to a vote; and 

determining whether the gesture is a valid gesture command. 

Claim 10 (Original): The method of claim 9, wherein the reference point is not 
interpreted as a gesture command. 

Claim 1 1 (Original): The method of claim 9, wherein the reference point is 
characterized by hand size and a location of a centroid of the hand in each 
image. 

Claim 12 (Original): The method of claim 9, wherein the first translation is one of 
a forward and a backward translation, wherein the first translation is 
characterized by a large change in hand size and a relatively small change in a 
centroid of the hand. 

Claim 13 (Original): The method of claim 9, wherein the second translation is one 
of a left, a right, an up and a down translation. 

Claim 14 (Canceled). 

Claim 15 (Canceled). 
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Claim 1 6 (Currently Amended): The method of claim 45 9, wherein the step of 
testing an input pattern further comprises the steps of detecting a circular 
movement, wherein an angle between vector c<Cm and vector c t .ic t .2 is 
determined as the feature vector. 

Claim 17 (Original): The method of claim 9, wherein the valid gesture is 
performed continually for a predetermined time. 

Claim 1 8 (Currently Amended): A program storage device readable by 
machine, tangibly embodying a program of instructions executable by the 
machine to perform method steps for dotormin i ng a gosturo automatically 
controlling a device , the method steps comprising: 

determining a change in a background of an image from a plurality of 
images; 

determining an object in the image sa i d dotorm i ning stop furthor 
compr i s i ng tho steps of: 

obta i n i ng a norma li zod co l or roprocontation for a p l ural i ty of co l ors 
' j) i n e ach i mag e ; 

fp/ det e rm i n i ng from tra i n i ng i magos an est i mat e of a probab ili ty 

' d i stribut i on of normal i zod co l or va l uos for an objoot G l ass; and 

dotormin i ng, for oaoh p i xo l , a li ko li hood accord i ng to an octimatod 
probab ili ty d e ns i ty of norma li z e d co l or va l u e s for th e obj e ct c l ass; 
dotorm i ning a trajoctory of tho objoot through tho plural i ty of i magos; and 
o l aGs i fying a goGturo accord i ng to tho trajoctory of tho objoot. 
identifying a gesture according to the trajectory of the object: 
determining if the gesture corresponds to a valid command: and 
if the gesture corresponds to a valid command, executing the command. 



Claim 19 (Original): The method of claim 18, wherein the step of determining the 
change in the background further comprises the steps of: 

determining a gradient intensity map for the background from a plurality of 
images; 

determining a gradient intensity map for the current image; 
determining, for a plurality of pixels, a difference between the gradient 
intensity map and the gradient intensity map for the background; 

determining a comparison between the difference and a threshold; and 
determining a pixel to be a background pixel according to the comparison. 

Claim 20 (Original): The method of claim 18, wherein the object includes a user's 
hand. 

Claim 21 (Cancelled). 
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Claim 22 (Cancel* 




Claim 23 (Cancels 



Claim 24 (Canceled). 

Claim 25 (Currently Amended): The method of claim 18, wherein the step of 
c l assify i ng translating the gesture further comprises the steps of: 
determining a reference point; 

determining a correspondence between the trajectory and the reference 
point; and 

classify i ng translating the trajectory according to one of a plurality of 
commands. 

Claim 26 (New): The method of claim 1 wherein the step of determining an 
object in the image further comprising the steps of: 

obtaining a normalized color representation for a plurality of colors in each 

image; 



determining from training images an estimate of a probability distribution 
of normalized color values for an object class; and 



determining, for each pixel, a likelihood according to an estimated 
probability density of normalized color values for the object class. 

Claim 27 (New): The method of claim 1 wherein the step of executing the 
command further comprises the steps of: 

determining the duration of the gesture; and 

correlating the duration of the gesture to a intensity and scale in which the 
command is executed. 

Claim 28 (New): The method of claim 1 wherein the device is a virtual 
endoscope. 

Claim 29 (New): The method of claim 28 wherein the command corresponds to 
rotation of the virtual endoscope. 

Claim 30 (New): The method of claim 29 wherein the gesture is rotation of a 
user's hand. 

Claim 31 (New): The method of claim 28 wherein the command corresponds to 
moving the virtual endoscope in a right to left direction. 

Claim 32 (New): The method of claim 31 wherein the gesture is waving of a 
user's hand from right to left. 
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Claim 33 (New): The method of claim 27 wherein repetition of a command 
increases the intensity of the corresponding command response. 

Claim 34 (New): The method of claim 1 , wherein the step of determining the 
object in the image further comprises the steps of: 

obtaining a normalized color representation for a plurality of colors in each 

image; 

determining from training images an estimate of a probability distribution 
of normalized color values for an object class; and 

determining, for each pixel, a likelihood according to an estimated 
probability density of normalized color values for the object class. 



Claim 35 (New): The method of claim 1 , wherein the step of determining the 
trajectory of the object through the plurality of images further comprises the steps 



determining, for each pixel, a temporal likelihood across a plurality of 
images; and 

determining a plurality of moments according to the temporal likelihoods. 





Claim 36 (New): The method of claim 1 wherein the identified gesture is a valid 
command if it detects object pixels moving in a predefined pattern. 



